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[57] ABSTRACT 

A machine is disclosed that is capable of locating human 
faces in video scenes with random content within two 
minutes, and capable of recognizing the faces that it 
locates. The machine uses images obtained from a video 
camera and is insensitive to variations in brightness, 
scale, focus, and operates without any human interven- 
tion or inputs. When a motion detection feature is in- 
cluded, (one of its options), the location and recognition 
events occur in less than 1 minute. One embodiment of 
the system uses: a camera, a Micro- Vax computer, an 
analog-go-digital A/D converter, and a hard copy print 
out to process video scenes with random content using 
an original computer program to locate human faces 
and identify them. In operation, the camera converts 
the video scenes into an analog electrical signal, which 
is converted into digital and forwarded to the com- 
puter. The computer performs an original pattern rec- 
ognition algorithm to search for facial components, 
identify a gestalt face, and compare the gestalt-face*s 
detected facial characteristics with a stored set of facial 
characteristics of known human faces, to identify the 
face thereby. 

1 Claim, 2 Drawing Sheets 
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ing momentary image of the same known person to 

AUTONOMOUS FACE RECOGNITION MACHINE obtain a second similarity score. The two similarity 

scores are analyzed to verify that the identity of the 

STATEMENT OF GOVERNMENT INTEREST interrogated person is that of the known person. 

The invention described herein may be manufactured 5 A Face Recogrntion Machme (FRI^ 

and used by or for the Government for governmental at the Air FmMrf technology (AFTD by 

purposes without the payment of any royalty thereon. Robert Russel in 1981The FRM was based on Cortod 

r r Thought Theory (CTT) which proposes a new model 

BACKGROUND OF THE INVENTION 0 f how a human brain processes i nform ation. Richard 

The present invention relates generally to pattern 10 Routh developed and presented CTT as a doctoral 

recognition systems, and more specifically the invention dissertation at AFIT in 1985. CTT proposes that infor- 

pertains to a machine of locating human faces in video mation is displayed as a two dimensional image on the 

scenes with random content, and capable of recognizing brain. The brain then extracts the essential information 

the faces that it locates. (the essence of the image) as a two-dimensional vector, 

Personal access control systems have been imple- 15 called a "gestalt'*. The gestalt is the only information 
mented using visual recognition for identification of that is passed to the higher levels of the brain for pro- 
individuals. Visual recognition systems use characteris- cessing according to Mr. Routh in his article entitled 
tic portions of the human body for identification pur- "Cortical Thought Theory: A Working Model of the 
poses. Typical of this type of access control are finger- Human Gestalt Mechanism.*' PhD . Dissertation, 
print recognition systems and facial feature recognition 20 AFIT/DS/EE/85-l, Air Force Institute of Technol- 
systems. One such system is described in U.S. Pat. No. 0 gy, DTIC Document, July 1985. Here, the FRM re- 
4,1 09,237, entitled "Apparatus and Method for Identify- duces facial images to gestalts and then compares the 
ing individuals through the Retinal Vasculature Pat- gestalt to a data-base in an attempt to recognize the face, 
terns", issued Aug. 22, 1978. This system uses a method j n 193$ ^ AFIT student added automatic face loca- 
of scanning the individual's eye with a light source 25 tion ^ wm( j 0 wing algorithms to the FRM to elimi- 
arranged in a selected pattern and detecting that portion human influence on the recognition process 
of the light source pattern which is reflected from the (Smith, 1986). The face locator was slow and recogni- 
person's retina, thereby locating each intercept of the Uon was less accurate because only the internal features 
light source pattern with a blood vessel. The intercept of the facc (eyes, nose, mouth) were used, but the ques- 
pattern thus obtained is then compared with stored 30 don ^ studcnt was try]nB to answer was, "Can a ma- 
intercept patterns previously obtained from individuals d ^ cntM Qn its Qwn> dfeterminc whcther or not a 
who are cleared for access. Personal access control ^ race j, in a icturc ^ if ^ can it determine to 
systems using visual recognition alone demand^ even Qm fac£ ^ ? ..^ answer b ^ ^ ^ 
higher leyel of techmcal effort and sophisticate than student's thesis effort became the Autono- 
aco^ucalr^ogmtion sys^ 35 Recognition Machine (AFRM) as devel- 

The problem with identification systems hke the one Edward* Smith, and as documented in his 

d Tt?k^*^^^ S ^tmed^vclopment of an Autonomous Face 

ual who is willing to subject himself to a retinal scan. x , , . „ w rt „*™ ^1 • acttv^t: 

The task of providing a system which locates human ^^r^^ a p T V. , ' f t^^Wv 

faces in vki£ scenes with random content, and then 40 ENG/86D-36, A11 -Force Institute of Technology, 

identifies the faces it locates is alleviated to some extent, DTIC Document, December 198^ 

by the systems disclosed in the following U.S. Patents, J^J^?? mventlo » ™ evaluation of 

the disclosures of which are specifically incorporated the AFRM location and windowing algorithms with 

herein by reference: the S oal of im P rovin g recognition score and speed. 

U S Pat No 4 449 189 issued Feix; 45 Bolh ^ 86016 md s P eed were reduced witn ^ addi " 

lis! Pat No! 3,999[006 issued Takeuchi et al; tion of the autonomous scene analysis (location and 

U.S. Pat. No. 4,773,024 issued Faggin et al; and windowing) algorithms in 1986, and human influence 

U S Pat. No. 4,625,329 issued Ishikawa. was eliminated. The goal of this effort was to reduce the 

Perhaps the most significant of the above-cited refer- 5 to 30 minute scene analysis time as much as possible 

ences is the Feix patent The Feix reference discloses a 50 while bringing the recognition score back up to a least 

personal access control system which uses speech and what was possible when human influence was allowed, 

face recognition. It relies on both a voice signature as Improvement of the windowing algorithms should 

well as the identification of the facial features of the improve overall recognition accuracy. There are sev- 

speaker. era * windows on the facial scene that will be tested as 

The face recognition system of the above-cited Feix 55 possible replacements for the windows that have little 
system resembles earlier personal identification systems affect on the recognition score. Going back to a whole- 
in that it requires a cooperative person who participates head approach used in 1985 should also improve accu- 
in his identification through a combination of both racy over the internal feature approach now used. The 
speech and face recognition. The voice signature of only reason internal features are now used is the inabil- 
interrogated person uttering a key word into a micro- 60 ity to separate the edges of the head from a .random 
phone is compared in a pattern matcher with the previ- background. This invention investigates two possible 
ously stored voice signature of a known person uttering solutions to this problem. The first is to apply an ellipti- 
thc same key word to obtain a first similarity score. At cal mask to a scene centered around the location of the 
the same time, when a key event in the utterance of the face with a size proportional to the size of the internal 
key word by the interrogated person occurs, a mornen- 65 features. This results in a larger area of the face being 
tary image of that person's mouth region onto which a made available to the recognition algorithm. The sec- 
grid pattern has been projected is optically recorded ond solution is to apply a Moving Target Indicator 
and compared with the previously stored correspond- (MTI) algorithm to a series of input scenes prior to 
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scene analysis. This may allow better detection of the Cortical Thought Theory (CTT), developed by Cap- 
edge of the head. tain Richard Routh, proposed a model of the human 

Improvement of the location algorithm may speed up brain that was based on primitives of analogy as op- 
the scene analysis, however the major improvement in posed to primitives of deduction. Routh described how 
speed will be gained by re-hosting the AFRM on a new 5 primitives of analogy could be used to achieve human- 
Micro- VAX computer and its related equipment like classification of data and human-like recall or, "di- 

While identification of cooperative individuals who rect memory access". The classification, or single 
participate in the identification process represents a unique identification of an object, was called the "ges> 
breakthrough in the art, a need remains to provide an talt" of the object 

improved system capable of locating human faces in 10 In 1985 Robert L. Russel applied CTT to the problem 
video scenes with random content, then recognizing the 0 f face recognition. The results of Russel*s work in- 
faces that it locates. The present invention is intended to creased the credibility of CTT as a model of human 
satisfy that need. sensory processing. In 1986, Edward Smith added an 

SUMMARY OF THE INVENTION automatic face location algorithm to Russet's face rec- 

13 ognizer to make the recognition process independent of 

The present invention is a machine capable of locat- operator influence, 
ing human faces in video scenes with random content The reader's attention is now directed towards FIO. 
and capable of recognizing the face that it locates. The 1( which k a rfor m facc rccogn ition machine (FRM) 
machine uses images obtained from a video camera and deve ] oped by Robert Russel in 1985, as presented in the 
is insensitive to variations m brightness, scale, focus, 20 abovCK:itcd Smith rcfcrcncc . The FRM of FIG. 1 is a 
and operates without any human intervention or inputs. ^^^^ systcm which accomplishes face recog- 
When a motion detection feature is included, (one of its mtion u$in ^ ^ c uter lf a Nova computer 2, 
options), the location and recognition events occur in a ^ ^ d 3, a 4> a ^ monitor 

esstnan 1 minute. 5 a cop i cr 5 a background terminal 7, a fore- 

One «nt"dunent of the present invent™ accom- 25 d Noy * uh , tcrminal „, a 

phshes these functtons in an unage processmg system * h 10 a s ^ er k ^ n _ Ml 

which uses: a video camera, a monitor, a computer, *1 . . . r . 1f -i U i j r 

Micro-Vax Intech board, and Tektronics hardcopy «f the ^P""**" commercially-aviukble. and some of 
nnit. The video camera is electricaUy connected to the the umts are listcd below m Tablc 
computer by Micro- Vax Intech board, which acts as a 30 TABLE 1 

computer mterface and digitizes the signals from the Computer System 

camera. The computer performs the image processing * tl z; , « *^ ' 
functions discussed above using an original program to \ ^ ata , G ^ ral J Nov 1 a 2 Computer System 
allow the monitor and hard copy unit to output the \ Octek 2000 video Processing BOard 
identity of the face recognized by the system. 35 4 * ? a « c 650 Vldc ° ?™ c ™ , w . 

It is an object of the present invention to provide an 5 - Panasonic WV-5490 Monochrome Monitor 
autonomous system which will fmd and recognize a 6 - Tektronix 4632 Video Hard Copy Unit 
human being in a video scene without knowledge of the ™* Nova computer 2 was used for image acquisition 
person's location or size. ano " di s pl av > anc * the Eclipse 1 was used for the large 

It is another object of the present invention to pro- 40 amount of numerical processing required by the gestalt 
vide a pattern recognition system which functions as a calculations. The two computers shared a common disk 
personal identification system while automatically cor- drive 13 communicated via flag files stored on disk. . 
recting for natural variations in a video scene environ- In man y cases these fla S flles existed in name only to tell 
men t. one computer that a process was finished on the other. 

These objects together with other objects, features 45 In some czses the flies contained data that was to be 
and advantages of the invention will become more passed from one computer to the other. Software for 
readily apparent from the following detailed descrip- ^ recognizer was written in Fortran IV and Fortran V 
don when taken in conjunction with the accompanying extensive use of subroutine swapping and overlay 

drawings wherein like elements are given like reference techniques were employed due to the small main mem- 
numerals throughout 50 ory t approximately 28 K bytes, available for running 

programs. 

DESCRIPTION OF THE DRAWINGS The equipment shown in FIG. 1 was used to acquire 

FIG. 1 is an illustration of a prior art face recognition and process images. The Octek 2000 video processing 
system; board 3 connected to the Nova 2 was used to acquire 

FIG. 2 is an illustration of the cursor adjustments 55 four-bit images from a black and white video camera 4. 
required for the system of FIG. 1 to capture and iden- Once acquired, an image could be stored to disk, dis- 
tify a human face from the background using the Russel played on the monitor or printed on the video hard- 
system; copy unit 6. In Russel's system, image acquisition was 

FIG. 3 is a block diagram of the components of the accomplished with a fixed camera setup and layout The 
face recognition system of the present invention; and 60 background was a plain piece of cardboard and the 

FIG. 4 is a block diagram of the total system option camera had to be calibrated to the brightness of this 
algorithm used in the process of the present invention. board. After taking a picture, the user provided the 
DFTAII ED DESCRIPTION OF THF computer with the coordinates of the face by manually 

The present invention is a machine capable of locat- computer had to divide the face into several separate 
ing human faces in video scenes with random content windows. Success in locating and windowing the face 
and capable of recognizing the faces that it locates. depended upon the contrast found in the scene and so 
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the input scene had to be pre-processed to obtain a its defined allowable variations in maxima and minima, 

constant contrast value. the maximum distance ratios between various points on 

Preprocessing consisted of a contrast enhancement the signature, and the maximum variation of the slopes 
algorithm that sampled the pixel values in the center of between maxima and minima, 

the face and adjusted the contrast of the whole face 5 The reader's attention is now directed towards FIG. 

based on the average of the center pixels. 3 which is a block diagram of an embodiment of the 

In Smith's system images were acquired using the present invention. The system of FIG. 3 is an image 
same equipment Russel used, but instead of providing processing system which use a video camera 100, a 
the computer with the face coordinates, the computer Micro-Vax interface board 110, Micro- Vax II computer 
ran an automatic face location algorithm. The Only 10 nQ f a monitor 130 and a hard copy printer unit 150 in 
requirements imposed on image acquisition was a cam- orc j er to identify people in the video scene captured by 
era calibration and the background was allowed to ^ e camera 100 using original software which is de- 
vary, scribed in detail below. The system of FIG. 3 is just one 

Success in locating and windowing the subject's fea- e^pfe of the application of the present invention, and 
tures still required a constant contrast value, so Russet's 15 uses equipment which is commercially-available. For 
contrast enhancement algorithm was still used. The examplef one version of ^ system included a Micro- 
algorithm was applied to the scene after the face locator Vax T^tech board, Dage 650 camera, Deanza video 
found most of the features of aface, in order to help it monjt and a Tejtfronics hardcopy unit The video 
find the rest of the features^ Then a slightly modified m b eIec ^ call connected to the computer 
version of the contrast enhancement algorrthm was 20 m Micn>V ax Intech board 110, which acts as 
apphed to the face to improve the accuracy and repeat- ^ ^ ^ ^ from ^ 

abihty of the windowing and ^^^^^ £ computer 120 performs the image process- 

There are two requirements of the face location algo* . . * . , • . . . , _ 

. * " . X 1 a ~* * « _ Ux i# . w o ing functions discussed above using an original program 

nthm used in the Autonomous Face Recognition Ma- 6 lt . _ . ^ A . , °„ -° ai^uZ ^ 

chine (AFRM). The first is to ensure that only faces are 25 ° * l ? w momtor ™ d . ha ^ d ^ to <N^ythe 

passed to the recognition algorithm and that all other ***** of people recognized in the video scene 

Jarts of the input Lne are discarded. The second re- Beforc Proceeding to a description of the software 

quirement is to find specific features on the face that programs, it is important for the reader to unders^ 

need to be used by the windowing algorithm. the characteristics of the pattern recognition process 

In Russel's FRM the first (face location) requirement 30 used in the present invention to recognize and identify 

was met by having the user position a block around the human faces * n » video scene. Therefore, the rea der s 

face as shown in FIG. 2. The second (feature location) attention is now directed towards FIG. 4, which is an 

requirement was met by using an automatic feature illustration of an algorithm of the present invention 

location algorithm. The accuracy of the feature loca- which searches for, recognizes, and identifies a human 

tions were dependent on the contrast of the input image, 35 face in the video scene provided by the camera 100 of 

the set of rules within the location algorithm, and some- FIG. 3. The object code that implements this algorithm 

times a manual correction entered by the user. will be provided below, but the purpose of FIG. 4 is to 

In Smith's AFRM the face location requirement was discuss the pattern recognition principles used in the 

accomplished using an automatic "facefinder" algc- present invention. 

rithm. Feature location was accomplished as a part of 40 When the object code is loaded into the Micro-Vax II 
the face location process. The facefinder works by computer 120 of FIG. 1, the monitor of the computer 
searching an input image for certain facial characteris- will display the Autonomous Face Recognition Ma- 
tics called "signatures". The facial signatures are pres- chine (AFRM) menu listed below as Table 2. When the 
ent in most facial images and are rarely present when no demonstration item of the main menu is selected, and 
face is present. Smith presented test results in his thesis 45 when the total system option is selected, the system 
that show how 4 *face specific" the facefinder was. performs the algorithm of FIG. 4 in the manner dis- 

The facial signatures are made up of the brightness cussed below, 

variations in a scene that are consistently found when a TABLE 2 

face is present The "eye signature" is made up of the " 

three brightness maxima found around the eyes (one 50 afrm Menu structure 

between and one to each side of the eyes) and the two " Acquisition of Images *» 

brightness minima found in the center of the eyes. These 7* 0: Return to Main Menu 

maxima and minima form a characteristic W W" shape f 

when the brightness on a line through the eyes is plot- / ^ Ta 

ted. Smith also defined a "nose/mouth signature". 55 Main Menu / 2 ! Movb^ar^t 

The development and calculation of the facial signa- 1; ' 3 : Load image from Memory 

tures was based in part on similar work in which spe- {. Find Face$ 4: Save image in [face] 

cific features in mug file images were located using a 3: Gestait and Identify/Save 

signature technique. The signatures were generated by 5: Camera Port 

adding pixel values in each column of the image and 60 * ****** of Dba * * : ^ era ' 

, . e p , . . . j • • 5: Delete a Subject 7: Re-Inttuuze Hardware 

plotting the results. Characteristic maxima and minima 6: ^fete an Image 

appeared at the center and edges of the face. Smith 7I Tram 

generated his facial signatures by extracting columns _ ^ • ^ . mm 

from an image and plotting the results of a one- *Dem°»™'°« " Demon«.r...o. 

dimensional gestait calculation for each column. 65 01 Qu " 0: Re,urn to Msm Menu 

After convolving the signatures with gaussiah func- ]■ l?"* 1 } 1 * * Person 

tion to smooth them, Smith applied a set of limits to __ . 2: Tom Sysiem 

determine if the signatures represented a face. The lim- 
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The process of FIG. 4 begins as the computer 120 tently, several preprocessing steps can be performed on 
acquires and stores an image 200 from the camera 100 of the input image. 

FIG. 3. After a one second interval, the computer ac- In Russel's FRM, the user was required to identify 
quires a second image 201 from the same scene and the location of the face by positioning a box-shaped 
compares it with the first image to determined if there is 5 cursor on the video monitor. The only part of the image 
movement 202. This is easily accomplished as follows. used by the FRM was the part inside the box. Smith 
Assuming a constant illumination for the scene, the provided the whole scene to the AFRM and added an 
second image acquired in step 201 should be identical automatic location algorithm to locate a randomly posi- 
with the first image acquired in step 200 in the absence tioned face in a random background. This location algo- 
of movement. That is, all of the digitized pixels in the 10 nthm could take anywhere from S to 30 minutes to find 
second image that indicated illumination would indicate the face in the scene which must be accomplished prior 
illumination in the first image; and all the darkened to recognition of the face. 

pixels in the second image would be darkened in the ^ step 204 of FIG. 4, the computer performs a pat- 
first image. The reason for this is that if there is no tern recognition program to search for a human face in 
movement in a scene that is subject to constant illumina- 15 ^ video scene. As the attached programs show, this 
tion, there should be no change in the image. Therefore, pattern recognition begins by searching the image for 
as part of the present invention, a moving target indica- ^ rec ognizable features of the human face: a pair 
tor (MTI) algorithm was added to the AFRM as the of cyes If no eyes are located in the scene, the computer 
first step in processing the scene, with the following will decide that no face is contained in the image, and 
assumption: 20 the program will return back to step 200, and reacquire 

"Faces may be present on moving targets but are ft new j^gg 
never present when there is no motion. (The motion A . Qf ' are rec0gni2cd ^ a pair or compara- 
must occur between the acquismon of two consecutive tiveI dark ^frm dipseSf which form ^ eye signa- 
scenes and the user will be allowed to bypass the Mil ^ Ifone fmds ^ dark objects with ncarly the same 
step m order to process previously stored or "still 25 siz ^ onencxtxoaito ^ ctt ^ n&possib]tpalToreyes is 

photos). . . . detected. A "dark" object in this case is an object with 

Using tins sumption the tone required to locate a £ eliminates false 

nTsc^^^^ -A*— ^ 

the system to distinguish the separation of the edges of 30 * ch ~* n « for ^° J^J*?^ %°?> 

the head from the background ™ ut . h > "™ othere are Sldebv 

Once movement has been detected 202, the system swe(eyes). 
will wait three seconds, and acquires a final image 203 u ™* new loca ^° r n algonthm is reasonable model of a 
whose contents will be searched 204 to find a human human ' ll « ha * *>' » human » a fac€ m a *™ 
face. The source code which performs this is called 35 # ven onc r lmc of at a tmie / . but casv lf # ven sma11 
"FACE.C", and it contains all the algorithms, all the T *& on * of scene. Research into eye scanning pat- 
code necessary for maintaining a fecial database, and tems show that k is UkeI y that Pe°P te are evaluating 
the menu structure shown in Table 2. When a user logs sma11 ^eas in a **** If b . ram can , determine 
on, the main menu is displayed on the computer screen. whether a dark object is present in a small area of a 
This menu provides access to the individual AFRM 40 scene, and reme^Her where that area is in reUtion to all 
algorithms and access to the database and demonstra- othcr ^eas, then it can easily recognize more comph- 
tion options that will be described below. cat «i objects in the scene given some simple rules. For 

Please note that the video equipment shown in FIG. example, a face decision rule would be: 

3 actually captures the image of the subject by snapping tn ere is a dark object; 

a picture in about l/30th of a second in step 203. If other 45 if » there is a second one beside it; 

rquipment is used, the amount of time used to take the # there k a tlurd below and between them; 

picture may vary, but the use of a relatively short expo- ^ there is a fourth directly below the third; 

sure time in actually taking the picture tends to produce then there is a face." 

a "stop motion** image which reduces the effects of If a pair of eyes are located in the scene, the pattern 

human motion on the acquired image. 50 recognition program will then search for nose and 

The AFRM menu structure is set up so that a user can mouth in proximity, with the eyes to constitute a gestalt 

run each algorithm independently of all the others. In face 205. As mentioned above, a prerequisite for recog- 

addition, an option called *Total System" is provided nition of a subjects face is a frontal view of the subject*- 

that runs all the algorithms in series as shown in FIG. 4. whole head. No information from behind the edges of 

No operator inputs are required once this option is 55 the head is allowed because this information comes 

selected except for selecting which camera to use and from an uncontrolled background. The MTI algorithm 

when to quit FIG. 4 shows the time spent in each algo- can separate a moving target from the background, but 

rithm and the time required for each loop. The subrou- it is not quite good enough to sue with only brightness 

tine in FACE.C that is represented by this flowchart is values from a black and white image. Smith chose to 

called "AFRM( )". 60 provide only the internal features of the head and this 

In order to recognize a subject, the AFRM must be resulted in a lower recognition accuracy. The technique 

given an image of the subject's face with no significant presented here, called an elliptical mask, is designed to 

(less than 5 degrees) tilt or rotation of the subject's head. provide the recognition algorithm with an approxima- 

This means that a frontal view of the person's head is tion to a whole-head view of the subject (providing less 

necessary for recognition. With no other constraints 65 information than the whole-head approach but more 

imposed on the image, the AFRM is required to locate information than the internal feature approach.) The 

and recognize the subject. In order to help the AFRM goal is to give the face recognizer as much information 

accomplish this task quickly, accurately, and consis- about the subject as possible without adding uncontrol- 
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Iable background data. In order to create an elliptical eyeglasses and mustaches if they get in the way ofscpa- 

mask, the following assumption is necessary. rating facial features. 

•The head is elliptical (available software allows easy The algorithm allows slight head rotation and varia- 

creation of only ellipses, circles or rectangles). The size tions in lighting direction (as long as lighting is still from 

of the head can be approximated if the size of tie inter- 5 somewhere above the subject), 

nal facial features are known." Once a complete face is identified in the image 205, 

Using this assumption and Smith's automatic face the data of the scene will be compared with data base 

location algorithm (to find and measure the internal which was stored in the computer in order to maintain 

features), the size of the subject's head is approximated. the gestalt files of all subjects entered into the AFRM. 

An ellipse of this size is drawn around the face and 10 This includes the files for subjects that the AFRM is 

everything outside the ellipse is cleared to a constant trained with, and extra files used for testing the recogni- 

brightness value. This new image is fed into the recogni- tion capabilities of the AFRM. When the AFRM is not 

tion algorithm with a whole-head on a pristine back- running, all the gestalt data are kept in two files called 

ground Testing the elliptical mask algorithm yielded "TRAIN.D AT;1 M and "OTHERS. DAT; L" These files 

the following result. The ratio between facial feature 15 are ASCII test files, so they can be displayed on the 

size and head size is not a constant. Because of this computer screen and printed to a printer. The data base 

result, the ellipse size and center location has to be software is contained in subroutine "MENU1" and is 

adjusted so that it does not extend beyond the edge of supported by the following subroutines which are all 

any subject's head. contained in FACE.C: 

When the new face location algorithm was tested on • 

the Micro-VAX, the following results were observed. copyfile getint 

The location algorithm finds faces in an input scene in del REadfile 

less than 2 minutes for the configuration of FIG. 3, display writefile 

subject to the following constraints. When the Dage 2J 

650 video camera listed in Table 1 is used, the input When the AFRM is first activated, the two disk files 

scene size is 512 by 480 pixels- are rad into arrays in the memory. The contents of these 

The system of FIG. 3 is able to locate at least one face arrays are modified using Main Menu options 3 through 

in an input scene, and perhaps up to 60 faces when they 7 while the AFRM is running and when option 0 (Quit) 

present a full, unobstructed frontal view to the camera, [ s selected, any modifications are written into the disk. 

The reason for this is that the minimum facial size neces- j t ^ important that the AFRM is tenninated only by 

sary for recognition is about 64 by 64 pixels. Since this using the Quit option, because all other methods of 

minimum facial size represents about l/60th of the input terminating the program (CTRL-C, CTRL-Y, etc) will 

scene size of 512 by 450 pixels (for the equipment de- prevent the modified array data from being stored onto 

picted in FIG. 3) the total number of faces that the 35 a disk. 

system could hypothecally identify is 60 faces. This ihe arrays used to hold gestalt data are implemented 

amount could vary as different equipment is used. using q structures so that subject names, file versions 

Therefore, the user is advised that he may have to deter- ^ gestalt values can all be held in the same array. The 

mine empirically the minimum facial size characteristic two structures are called TLIST and ILIST and the 

if other equipment is used as opposed to that shown in 40 contents of these structures are global, available to all 

FIG. 3. the subroutines that need to access them. Main menu 

As mentioned above, the system has a limit of less options allow the user to add to (by training), subtract 

than about five degrees on the amount of tilt and rota- f rom (delete trained subjects or individual images), and 

tion that can be tolerated in a subject's head with re- display the contents of the structures, 

spect to the camera. The reason for this limit is that 45 The gestalt data files are stored on disk in a directory 

excessive tilt and rotation of the subjects head will called [FACE.DBASE] along with all the picture files, 

produce a foreshortening ofthe head's image within the The picture files are stored by subject name and an 

perspective of the camera. Human motion does not extension that identifies the status of the subject: IMG 

appear to present a problem to the system when the fiJes are pictures that the AFRM has not been trained 

equipment listed shown in FIG. 3. More specifically, 50 with, and PIC files are pictures the AFRM has been 

the video equipment actually snaps the picture used by trained with. These extensions are automatically 

the invention in about l/30th of a second. This effec- changed by the AFRM when a subject is moved from 

lively serves as a "stop motion " picture of the subject one area of the database to the other. The picture files 

which does not seem to be effected by normal human are also stored with version numbers that match the 

morion. The user is advised that the effects of human 55 version numbers in the data files, so the gestalt file is 

morion, rotation, and tilt of the subjects may have dif- always linked to the photo it was obtained from, 

ferent limitations when equipment other than that Once the face has been identified the pattern recogni- 

shown in FIG. 3 is used, and these effects would have to tion subroutine will quit 207 and return to the menu 208. 

be determined empirically. This includes time to pre- At this time, the monitor 130 will display the menu of 

process, time to locate features, and time to store each 60 Table 2, and the hard copy printer 150 can print out the 

face to a disk. identity of the face from the memory of the computer 

The location algorithm is scale invariant As long as 120 of FIG. 3. If the face is not recognized the computer 

features sizes match each other within a face, it doesn't will indicate this, and return to the step of acquiring 

matter what the overall sizes are as long as they are another image 200. The reason for this is because of the 

under a maximum defined limitation. 65 possibility that the person is recognizable by the com- 

The location algorithm is brightness invariant. The puter, but the facial angle or lighting in the image might 

brightness normalization algorithm takes care of varia- not have provided an image that conformed with the 

tions in the input scenes. The algorithm is sensitive to gestalt-face stored in the computer memory. In other 
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words, the system simply takes a second look, and tries and when that computer is electrically connected to the 
again to identify the subject commercially-available equipment of FIG. 3 the result 
The Computer Program Listing Appendix, which is is the autonomous face recognition system of the pres- 
presented below, contains the entire face recognition ent invention. The code contains comments which pro- 
code necessary to use the present invention. When this 5 vide a description of the operations that are being ac- 
code is input into the Micro-Vax II computer of FIG. 3, cbmplished as the code is run through the computer. 

if (fy ( { sy + size) ) re£urn(0) 

for (x=size-l; x(« 511; x-x+size) /* find left side */ 
for ( y « 0? y ( ,255; y»y+size) 
z. - brpixel(x,y); 
if (mode « 6) z z & 63; 
if(z )« thresh) 

sx * x « 512; 

x « y 512; 

if (sx »« -1) retura(O); 

for x ■ 512-size; x) (sx + size-1) x « x - size) / 
f or ( y - 0; y ( 255; y = y + size) find right side */ 
z - brpixed(x,y); 
if (mode «» 6) z « z & 63; 
if (z ) « thresh) 
fx » x + size-1; 

X « -1; - 

y - 512* 

if (fx ( (sx + size)) return(O); 
return (1); 

Jd^inr^riw-^^^i^ I* 1636 are the transformations used in the 
Ulilnl !? ( flw* '°i? 0 ?f % 7 /I f eedback lut for the real time subtraction 
^define Al (short int)al(x) /* demo. This software was created by using 

tittlZ m < ( £ 5 °l° f * 0 li C l » 6 /* the toolbox Program (see FG-100 uslr's * 
2?/* 2 ata &= Oat «c0» data 1 - (i & 0x003f); /* manual chapt 7) * 
#define Dl(i) data &« Oxf03f;'data 1 = ((i (<6) & OxOfc)); /******£***;**** 
♦define INPUT 0x6000 >i. i 

#define ab(i) (((i) ( 0) ? (-(i)) : (i)) 

xform2(addr, initial) 
unsigned addr, initial; 

register unsigned short i « addr; 
register short int data = initial; 
D1(A1 - AO); 
return( (unsigned)data;, 

x f orm2 ( addr , initial ) 
unsigned addr , initial; 

register unsigned short i * addr; 
register short int data = initial; 
D1(A0); 

D0(abs(Al - AO); 
return( (unsigned )data) ; 

/**************** ********************************** ************* 

afrm() /* A completely ^Autonomous Face Recognition Machine (AFRM) */ 

int cam; » 
char t2[30],t3[3b],stop,answer[l]; 
register unsigned j; 
stop « 1 n 1 ; 

printf( H /n Select camera port (0,1 or 2) ) M ); 
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scanf ("%d,&cam); 
while (stop == 'n*) 
clsO? 

printf (" please wait..."); 
rt subtract (0); 
se t earner a (cam) ; 
setlu t(0,0); 

setinmux(6) ; m m 

for (j«-0 j(0xl000; j++ write lut { INPUT, j,xforra2 (j, read read_lut (INPUT, 3 ) ) ) ; 

cls(); ^ 

printf ("looking for target.-); 

snap(l); 

snap(l); 

while((isolate(8,6,32) != 1) snap(l); 

printf ( M /n found targaet, acquireing 8 bit ijnage."); 

initialize! ); 

se t camera ( cam ) ; 

waitv(); 

snap(); 

nf « sx ■ sy = 0; 

^ « 511; ■ 
fy = 255; /* presently isolataed() only looks for target in top */ 
if (facemapO »= 1) /* half so look for faces in top naif */ 

printf ( '/» found •); 

printf ( M %d,nf); 

if (nf 1) printf( M face,"); 
else printf ("faces," ) ; 
facerec(2) ; 

printf ( M /n Do you wish to stop? (Y/N) )"); 
scanf ( M %s" , answer ) y 

if (answerCOD *Y* : answer[0] == »y) stop = »y* ; 
return; 

y********************* ************************************** ***********/ 

clear_cray( ) 

int x,y; 

for (y=l; y!29; y++) for (x-1; x(129; x++ cray[x][y] = 0.0; 
return;' 

y**** ******************************************************** *********/ 

cortran!6() /* Modified from C0RTRAN16 • FR 11/23/85 by R. RUSSEL */ 

int j,i,iwinmaxx,xtot,ytot # num; 
double c,bmax,ir3d, jr3d; 
xtot ■ ytot = num <= 0; 
for (i^i? i(iy+2; i++) 
for (j=l; j(ix+2; j++) 
if (crayj][i] ) 100 
xtot += j; 
ytot +« i; 
nura++; 

ir3d = (double) (ytot/num); 
jr3d = (double) (xtot/num); 

iwinmax - iy; /* scale */ 

if (ix ) winraax) iwinmax - ix; 

ir3d3 - ir 3d* (128 .0/ (double ) iwinmax) +0.5; 

jr3d3 « jr3d*(128.0/(double)iwinmax) +0.5; 

return; 

y*** ***************************** ***************************************** / 
del() ■ ' 

printf ("n/n Deleting files with reserved names."); 

system( "delete bnorxn.img, *" ) ; /* these names are reserved for facefinder */ 

syytem ("delete orig. img, * N ) ; 

return; 

/***************** *********************************** **********************^ 
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/* display bright^ norm face */ 
/* get fx,fy values */ 



f acerec (vera ion ) 
int version; 

char Ch[2],t2[30] f t3[30] # t4[30p) # t5[30]? 
int w t l,ra f n,p,dx,dy; 
if (nf :=o) 

cls(); 

printfC trying to recognize faces found...* 1 ); 
for (n«l; ra(nf+l; m++) 

t2[0D - */0'; /* create file names for face # m */ 

tfCO] - '/0*; 
strcat <t2, M bnorm.img;/0"); 
strcat <t4, H orig.img;/0 M ); 
t3[0] » m + '0'; 
*3[1] - '/0'; 
strcat(t2 # 3); 
strcat(t4,t3); 
sx ■ 60; 
sy m 30; 

printf(»/n%s,t2), 
sciear(0,l); 

readim(sx, sy, 200,200, t2, "nocom" ) ; 
1 m 8 y; 

while <brpixel(sx,l) !=0) 1++; 
fy - 1 - 1; 
1 « sx; 

while (brpixel(s,sy) !«0) 1++; 
fx ■ 1 - 1; 
dx = fx - sx; 
dy - fy - sy; 
cont_enhance (m) 
scale (m) 

text(70,10,0,l,0,t2); 
gestalt ( ) ; 
initialize(ra) ; 
sclear(Ojl); 

readim(200, sy , 200, 200, t4, "nocom" ) 
text(200,10,0,l,t4); 
if (version »» 1) 

printf( M /n Save in dbase? (Y/N) ) •')• 

scanf ( M %s M ,t3); 

if (ch[0] e» »y* ch[0] — »Y#) 
printf( M n enter name of subject (up to 10 letters) /n)• , - 
scanf ( ,, %s M ,t3) ; ' 
p = 0; /* highest existing version # for this subject */ 

for (n=l; n(k+l; n++) 

if (strcmp(ilist[n] .name, t3) «» 0) 

k - k + 1; 
p = p + 1; 

ilist[k] .nametO] « '/0»; 
strcat (ilist[kj .name, t3; 
ilist£k]num = p; 
for (w«l; w(7; w++) 

ilist[k].winx[w] - ilist 0].winx[w]; 

ilist[k].winy w] »-,ilist[0] .winy[w] ; 

t5C0] - */0*; 

strcat (t5, *[f ace. dbase]/0 "); 

strcat (t5 , ilistQk] .name ; 

strcat (t5 , " . img; /0" 

saveim(200,sy,dx,dy,0,t5, "nocomm 1 *); 

writef ile("[ face. dbase3others.dat 'l-, ilist ,k); 

else 
if (m (nf) 

prin 5?il^ Fo * get about rest of faces and return to main menu? (y/N) )"; 
scant ( %s ,ch); 

if (ch[0] »= >y> ch[0] « *Y' ) 
return; 



/* gestalt values put in ilist[0] */ 
/* display original face */ 
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recognize(O); - /* pass in gestalt values of ilistCol */ 

delet(t2) ' 
delete (t4) 
cls(); 

else . • 

printf( M /n face not found."); 
prtc(); 

-nf = sx = sy = 0; 
f x = f y = 511; 
return; 

/**************** ***************** *** ******* ********************************** 

static int results [2573C53; 

static int list[0]; /* list of id#s ordered by distances in list2 */ 
static double [0] ;list2[101] ;/* total distances (for all windows) */ 
static double v[1013C73; /* v[id][w] - distance from person #id to 
unknown person for window #w (Russel), 1985:4-40a) */ 

/***« ****************************************************** * **************** 

recognize (num) /*from REMID.PR 06/03/86 by R. Russel */ 

int num; /* the position in ilist[] of gestalt values to use. */ 

char t8[303; 

double gix,gi,gux,guy, sigix, sigiy # a,b,c, most; 
int id,w,m,n, j,conf id, test; 

double p[7] » 10. 0, 1.0,1. 5, 2.,0,3. 0,1.0 ; /* window performance factors 
(update after training and testing with sufficient samples */ 
/* note: p[0] is used for total of factors */ 
printf ( M /n/n/n Now tring to recognize subject in top half of screen./") 
printf("/n Presently trained with %d subjects. (i/4) ; 

for (w=l; w(7; w++) 
for [id=l; id((i/4)+l; id++) 
n = -id*4 3; 

gix = (double) <tl'ist[m] .winx[w] + tlist[m+l] .winxlw] + tlist[m+2] .winx[w] 

+ tlist[m+3].winx[w]) )4.0; 
giy » (double) (tlistCm] .winy[w] + tlisttnwOL] .winy[w] + tlist[m+2] .winy[w3 

+ tlist[m+3].winy[w]) )4.0; 
gux = (double) ilist[num] .winx[w] ; 
guy = (double) ilistQnum] .winytw] : 

sigix = ( (double) (abs (gix-tlist[ia] ,winx[w]*abs (gix-tlist [m] .winx[w]+ 
abs(gix-tlistCm+23.winx[w3*abs(gix-tlist[m+l3.winx[w3+ 
abs (gix-tlist[m+23 .winx[w]*abs (gix-tlist[m+23 .winx[w3+ 
abs(gix-tlist[m+3].winx[w]*abs(gix-tlist[m+3].winx[w]) ) )/4.0; 

sigix = sgrt(sigix); 

if(sigiy ( ,5) sigix =.5; 

sigiy - ( (double) (abs (giy-tlist[m] .winy[w]*abs (giy-tlist[m] .winy[w]+ 
abs(giy-tlist[m+2] .winy[w]*abs(giy-tlist[m+l] .winy[w]+ 
abstgiy-tlist[m+2] .winy[w]*abs (giy-tlistCm+2] .winy[w]+ 
abs(giy-tlist[jn+33-winyCw]*abs(giy-tlist[m+3D.winyCw]) ) )/4.0; 
sigiy = sqrt(sigiy); 
if (sigiy ( .5) sigiy = .5? 
a » (gix-gux)*(gix-gux)/(4*sigixsigix); 
b » (giy-guy)*(giy-guy)/(4*sigiy*sigiy); 
c = a + b? 

vCid3Cw>= exp(-l*0+c/l.4) * p[w3; 

for (id=l; id((i/4)+l id++) 
t[id3 « 0.000000001; 
for (w=l? w(7; w++) 
t[id3 v[id3Cw3; 

tCidl = tCid3/p[03; /* max t[id3 = 1.0 when distance form id to unknown */ 

/* -individual = 0.0*/ 

/* now have all distances ordered by id#, need to order id#s by distance */ 
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for (m»l; m(101; m++) 
list[m] = 0; 
list2[n] - 0.000000001; 

for (m=l; m((i/4)+l; m++) 
most m 0.000000001; 
for (j-1; j(i/4)+l; j++) 
if ) most) 

most « t[j]; 
n « [j;] 

list[m] - n; /* id # #/ 

list2[m] - t[n]; /* distance */ 

t[n] « 0.000000001? 

/* now .have ordered list of candidates, need to display them */ 
test «0? 

if (list2[l] 0 0.001) 

printf( M /n/n Candidate Distance" ); 

/* printf{" Confidence"); */ 
for (noli m(i/4)+l; m++) 
if(ilist2[m] == 0.001) 
if (m ~ 1) 

print f("/n 1st Choice:"); 
t8[0] « '/0'; 

strcat(t8, "face.dbase]/0 M ) ; 

strcat(t8,tlist>[HstCl]*4 - 3]. name); 
strcat (t8, M . pic/0" ) ; 

readira(50,286,200,200,t8,"nocomm") • 

text(5D,266,0, 1,200, tlistCtlistClistCijM - 3]. name; 
test ** 1 j * 

if (m ==2) 

print (:/n2nd Choice:"); 
tSCOJ - '/0,'; 
s treat ( t8, [face . dbase]/0 " ) ; 
strcat(t8,tlist[li s t[3]*4 - 3]. name); 
strcat(t8, ".picAT'L- 
'readim^OO^Se^OO^listClistill^lM - 3]. name ) • 
test m 2: 

if (m 3) 

printf(;/n 3rd Choice:");. 
t8[0] = ,0,; 

strcat{t8,"[face.dbase3/0"); 
strcat(t8,tlist[list[3]*4 -3. name); 
strcat(t8, ".pic/0"); 

readim(350, 286,200, 200, t8, "nocomm: ) • 

text(350,266,0,l,200,tlist[listC2]M - 3]. name- 
test * 3; ' 

if (m 4) printf("/n- Others:"); 

if (m ) 4) printf("/n ») 
/* confid - based on distance of this candidate and 

. t distances to next candidates */ 

/* printf(«%lls %f%tlistClistm]*4 - 3] .name, list 2 Em] ; 

prmtf(" %d",confid);*/ L J ' 

else m»200; 
if {test »m o) 

Pr ^ n Hi^ n/ iL COUld not find an V mor e close enough candidates.") 
printf("/ n The computer has never, seen this person before!")? 

if ( test ( 3 && test !« 0) 

printf('/n/n Could not find any close enough candidates .«) 7 
if (test i) pnntfr/n only displayed 1 picture."); 
else printf(Vn only displayed 2 pictures "). * 
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prtc(); 
return; 



The easiest way to get to know the AFRM is to sit 
down and use it The AFRM will perform several sec- 
ond of hardware and software initialization and will 
them present the main menu. When you are done using 
the AFRM, return to this menu and select the QUIT 
option. 

Two Things You Should Not Do 

1. The AFRM needs to create temporary files now 
and then as a normal part of its operation. It will delete 
these files as soon as they are no longer needed. Since 
these files are created and deleted without informing the 
user, the user should avoid saving files with these tem- 
porary-file names. Never save faces in files named: 

BNORM.IMG 
ORIGJMG 

at some un-announced point in time YOU WILL LOSE 
THEM. 

2. The AFRM has been designed to be fault tolerant 
You can enter anything you want, at any prompt you 
want, and the AFRM should handle it. The AFRM will 
inform you if your input is invalid. The only entries not 
allowed are CTRL-C and CTRL-Y which terminate 
the program without going to the main menu option 
QUIT. These are not allowed because the ARM will 
not be able to save updated database files and because 
the user will be allowed into the FACE account here he 
shouldn'be (the AFRM won't cause an automatic log- 
out). 

During normal AFRM operation this is not a concern 
for the user because the CTRL-C and CTRL-Y entries 
are disabled by a protection scheme. It is only men- 
tioned here to remind Special Users (those who modify 
install or initialize the system) to re-install the protec- 
tion scheme when they are done and to make them 
aware of the consequences of CTRL keys when protec- 
tion is not in place. 

There are several ways to input images into the 
AFRM and there is a sub-menu for all the options. This 
sub-menu is obtained by selecting main menu option # 1 . 
Most of the menu options are self-explanatory and so 
minimum detail is given here. 
0: Return to Main Menu 

1: Stationary Target— Allows acquisition of a 512x480 
image from the camera. 

2: Moving Target— Acquires a background scene from 
the camera (nobody in it), then acquires a second 
scene (with subject). The AFRM will provide the 
rectangular area that is different in the two scenes. 
This target area is all that is processed by the face 
locator (if locator is selected) and so the face locator 
will be faster than it would be for a full size scene. 

3: Load From — Allows user to load a previously stored 
image (for example, an image stored in the user's 
personal account on SMV2A). 

4: Save in [FACE]— You can save images in this ac- 
count if desired but please reserve the space in this 
account for images that are useful to everybody. 

5: Set Camera Port— The default port is (0) and this 
allows use of the Dage camera. The two General 
Electric cameras are connected to ports (1) and (2). 

6: Camera Check— Allows continuous acquisition of 



images so you can position and focus the camera. 
7: Re-initialize Hardware — Go back to default camera 

port, clear the screen, etc. 
j 0 Main menu option #2 runs the face location algo- 
rithm. This algorithm will look for faces in the image on. 
the screen and save all it finds to temporary files. 

Main menu option #3 only works after a face(s) was 
found by option #2. If no face(s) was found then this 
j 5 option will return to the main menu. This option runs 
the gestalt algorithm on the first face found by option 
#2. Then it runs there cognition algorithm on that face. 
During recognition the user is allowed to save the face 
and its gestalt data in the database. There is no other 
20 time when a new face and its gestalt data are available 
for saving in the database so save it NOW if you want 
it, otherwise you will have to Gestalt it again later 
(faces are easily deleted from the database if you change 
your mind later). If more than one face was found in 
25 option #2 than all faces will be gestalted and identified 
in the order found. 

Several main menu options are discussed below in 
Table 3 because they all have something to do with 
using and changing the debase 

30 

TABLE 3 

Display Contents of Database 

Delete a Subject— To "delete a subject" means to delete 
35 the training file for this subject. The actual images 
and gestalt values can still be saved in the . IMG 
section (files it is not trained on) and the AFRM can 
be retrained with this subject later. You may also 
delete this subject from the database altogether if 
desired. 

Delete an Image— This option allows the deletion of 
single images (files that the AFRM is not trained on) 
from the database. 
Train— This allows the user to train the database with 4 
files from the . IMG section of the database. The files 
must all have the same name and must have different 
version numbers. To exit this option at any time, enter 
a negative version number. 
Fault tolerance is really evident in the AFRM be- 
50 cause it is important to maintain a correct database. The 
AFRM constantly checks user inputs for validity and 
gives out pertinent information when it finds a mistake. 
For example, suppose, it is decided to train the AFRM 
with the name Smith, version numbers I, 2, 3, and 4. 
35 The AFRM will verify that the name you enter exists in 
the . IMG section and that it does not exist in the trained 
section. It will verify that files exist in the trained sec- 
tion. It will verify that files exist for all the versions you 
type in and that you have not typed the same version 
60 number more than once. If you make a mistake and wish 
to exit to the main menu, you are allowed to so at any 
time. 

The Total System option allows the user to run all 
AFRM algorithms together starting at image acquisi- 
65 tion and ending with recognition. This option is run as 
follows: 

1. Run the "Camera Check" option and set the camera 
up to take a full body picture of a standing person. 
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Then ensure nobody is standing in the filed of view of 
the camera. 

2. Select the total system option. 

3. Select the camera port desired. After a couple sec- 
onds, the screen will go black as the camera continu- 5 
ally acquires images and the itex board applies real- 
time subtraction. 

4. When the screen is black, have a subject walk into the 
field of view of the camera, turn and stare at the 
camera, and stand still for a few seconds. As soon as 10 
the AFRM "sees" the subject it will snap a picture 
and begin to look for a face. 

(There is no sharpening option to worry about about 
here.) If a face is found, then the AFRM will gestalt it 
and try to recognize the individual. (There is no save 
option here.) 

5. After recognition, the user will be asked if the whole 
process should repeat 

While the invention has been described in its pres- 
ently preferred embodiment it is understood that the 
words which have been used are words of description 
rather than words of limitation and that changes within 
the purview of the appended claims may be made with- 
out departing from the scope and spirit of the invention 
in its broader aspects. 

What is claimed is: 

1. A face recognition video system which locates and 
recognizes a human face in a video scene which has an 
input scene size of about 512 by 480 pixels and a random 
background, wherein said face recognition video sys- 
tem identifies said human face with a set of stored char- 
acteristics which are correlated with known human 
faces, said face recognition video system comprising: 
a camera which receives said video scene and outputs 

it in an analog electrical signal; 
a means for converting analog signals into digital 
signals, said converting means receiving and con- 
verting said analog electrical signal from said cam- 
era into a digital electrical signal; 
a means for applying an elliptical mask to said video 
scene around a location of said human face for 
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recognizing and identifying human faces, said ap- 
plying means receiving said digital electrical signal 
from said converting means and locating said 
human face within that video scene by, searching 
for and extracting detected racial characteristics 
within said video scene, said applying means then 
applying said elliptical mask around the location of 
the human face and defining a detected gestalt-face 
within said video scene with a minimum facial size 
of 64 by 64 pixels by identifying said detected facial 
characteristics using the detected facial character-, 
istics of whole human faces by comparing said 
detected facial characteristics of said detected ges- 
talt face with said set of stored face characteristics 
and ourputting a name associated with the stored 
face characteristics which successfully correlates 
with said detected gestalt face, wherein said apply- 
ing means comprises a Micro Vax computer which 
has a memory which has said set of stored face 
characteristics stored therein along with a set of 
names of said known human faces, said Micro Vax 
computer being electrically connected with said 
converting means to receive said digital electrical 
signal thereby, said Micro Vax computer searching 
said video scene for detected facial characteristics 
beginning with a search for a pair of eyes in said 
video scene, said Micro Vax computer outputting a 
signal to indicate that there are no human faces in : 
said video scene when no pair of eyes are detected, .• 
said Micro Vax computer continuing to look for : 
said facial characteristics once a human face is 
detected until it has sufficient detected facial char- 
acteristics to form said detected gestalt face which 
may be compared with said set of stored face char- 
acteristics and to identify said human face in said 
video scene thereby; and 
and a means for displaying said name produced by 
said applying means, said displaying means being 
electrically connected with said applying means to 
receive said name therefrom. 
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